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THE FREENESS PROBLEM OVER MATRIX SEMIGROUPS AND 

BOUNDED LANGUAGES 

EMILIE CHARLIER AND JUHA HONKALA 

Abstract. We study the freeness problem for matrix semigroups. We show that the 
freeness problem is decidable for upper-triangular 2x2 matrices with rational entries 
when the products are restricted to certain bounded languages. 

(N 

^C ! 1. Introduction 

In this paper we study the freeness problem over matrix semigroups. In general, if 
S is a semigroup and X is a subset of S, we say that X is a code if for any integers 
m, n > 1 and any elements x%, . . . , x m , yi, . . . , y n G X the equation 

x x x 2 ...x m = y x y<i ...y n 

implies that m = n and Xi = yi for 1 < i < m. The freeness problem over S consists of 
deciding whether or not a finite subset of S is a code. 

The freeness problem over S can also be stated as follows. Suppose E is a finite 
^ . nonempty alphabet and /i : S + — > S is a morphism. Then the freeness problem over S 






is to decide whether or not /i is injective. 

For a general introduction to freeness problems over semigroups see |CN12j . 

An interesting special case of the freeness problem concerns freeness of matrix semi- 
groups. Let R be a semiring and let k > 1 be an integer. Then the semiring of k x k 
matrices (resp. upper-triangular k x k matrices) is denoted by R kxk (resp. -R U p tr ). 
The sets R kxk and R^ptr are monoids and the freeness problem over R kxk is to decide 
whether or not a given morphism 

// : £* -> R kxk 



X 



is injective. Most cases of this problem are undecidable. In fact, Klarner, Birget 
and Satterfield [KBS91J proved that the freeness problem over N 3x3 is undecidable. 
Cassaigne, Harju and Karhumaki |CHK99] improved this result by showing that the 
problem remains undecidable for N 3 ^ 3 . Both of these undecidability results use the Post 
correspondence problem. Cassaigne, Harju and Karhumaki also discuss the freeness 
problem for 2x2 matrices having rational entries. This problem is still open even 
for upper-triangular 2x2 matrices. For some special decidable cases of the freeness 
problem for 2x2 matrices see [CHK99] and |Hon09] . 

In this paper we discuss the problem whether or not a given morphism // : S* — > Q U p tr 
is injective on certain bounded languages. This approach is inspired by the well-known 
fact that many language theoretic problems which are undecidable in general become 
decidable when restricted to bounded languages. Our main result is that we can decide 
the injectivity of a given morphism jjl : {x, Z\, . . . , z t+1 }* —> Q^ r on the language L t = 
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ZiX*z 2 x*z 3 . . .z t x*z t +\ for any t > 1, provided that the matrices fi(zi) are nonsingular 
for 1 < i < t + 1. To prove this result we will study the representation of rational 
numbers in a rational base. 

On the other hand, we will show that if we consider large enough matrices the injec- 
tivity problem becomes undecidable even if restricted to certain very special bounded 
languages. Hence, contrary to the common situation in language theory, the restriction 
of the freeness problem over bounded languages remains undecidable. The proof of our 
undecidability result will use a reduction to Hilbert's tenth problem in a way which 
is commonly used to obtain various undecidability results for rational power seris (see 
[KS86J ) and which is also used in [BHH + 08] to study the mortality problem for products 
of matrices. 

2. Results and examples 

As usual, Z and Q are the sets of integers and rational numbers. If k > 1 is an 
integer, the set of k x k matrices having integer (resp. rational) entries is denoted by 
Z kxk (resp. Q kxk ) and the set of upper-triangular k x k matrices is denoted by Zj^ 

(resp. «0- 

We will consider two special families of bounded languages. Suppose t > 1 is a 
positive integer. Let 

^t = {x, Zi, . . . , z t +i\ 
be an alphabet having t + 2 different letters and let 

A = {x,y,z u z 2 } 

be an alphabet having four different letters. Define the languages L t C EJ" and K t C A* 

by 

L t = Z\X z 2 x Z3 • • ■ z t x z t+ i 

and 

K t = z 1 (x*y) t - 1 x*z 2 . 
We can now state our results. 

Theorem 1. Let t be a positive integer. It is decidable whether or not a given morphism 

such that n(zi) is nonsingular for i — 1, . . . ,t + 1, is injective on L t . 

Theorem 2. There exist two positive integers k and t such that there is no algorithm 
to decide whether a given morphism 

is injective on K t . 

We will continue with examples which illustrate the problem considered in Theorem HJ 
In the examples we assume that t is a positive integer, 

h 2x2 



n ■ n -» 



£uptr 
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is a morphism such that /J,(zi) is nonsingular for % — 1, . . . , t + 1. We denote 

/i(x) = M and /i(-2j) = iVj 
for i — 1, . . . ,t + 1. 

Example 3. Assume that t = 2. Let [i(x) = ( n i ) anc ^ ^ M 2 ^) = ( n ^ )' Then 

(9 . QTn+n om 
3 

for all m, n G N. Hence // is injective on L 2 . 

Example 4. Assume that t — 1. Let M = c( „ -. ) where 6, c G Q and c 7^ 0. Then 

for all n > 0. It follows that there exist different integers m, n > such that 

M =M 



if and only if c G {—1, 1} and 6 = 0. Hence /z is injective on L\ if and only if c G^ { — 1, 1} 

or b 7^ 0. 



Example 5. Assume that t = 2 and let M be as in Example HI Let 
where A 2 , 5 2 , C 2 6 Q. Then 



M m N M n = c m+n ( A2 A2bn + B<2 + C ' 26m 

v o c 2 

for all m, n > 0. This implies that if c G^ { — 1, 1}, then /j is injective if and only if 
A 2 b 7^ C 2 b. If c G { — 1, 1}, then \i is not injective on L 2 . 

Example 6. Assume that t > 3. Let M and N 2 be as in Example [5] and let 

^3 B 3 



N 3 



C, 



where As, B 3 , C 3 G Q. Then we can find two different triples (mi, m 2 , 777,3) and (ni, n 2 , 773) 
of nonnegative integers such that 

777i + 777 2 + 7T7 3 = 77i + 77 2 + 77 3 

and 

C 2 C 3 m l + A 2 C 3 m 2 + A 2 A 3 m 3 = C 2 C 3 n x + A 2 C 3 n 2 + A 2 A 3 n 3 . 

This implies that 

M 7V 2 M A^ 3 M 3 = M N 2 M N 3 M 3 

which shows that \i is not injective on L t . 
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3. Proof of Theorem [1] 

3.1. From matrices to representations of rational numbers. For any r G Q\{0} 
and any word w = u> n _i • ■ ■ WiW (where the Wj's are any digits), we define the value of 
w with respect to the base r to be the number 

ra-l 

val r (u;) = \ WjT 1 . 

For any number m, we introduce a corresponding letter denoted by m such that 
vaL-(m) = m holds for any base r. 

The following lemma is straightforward. 

Lemma 7. Let M = c( „ 1 ) where c,a,b G Q. Then 



M n _ n ( a n val a (V 

V o i 



for any n > 1 . 

The following lemma shows that in order to prove Theorem [1] we can study repre- 
sentations of rational numbers in a rational base. 

a b 



Lemma 8. Let s > 1 be a positive integer, let M = c( J with a, o, c G Q and, 

for i = 1, . . . , s + 1, let Ni = ( * „* j ioi£/i Aj, B i7 Ci G Q. T/ien we can compute 
rational numbers q\, . . . , q s+ i,pi, . . . ,p s such that 

(1) 

N 1 M mi N 2 ---N s M ms N s+1 

mi +...+m s ( Ai • - • A s+1 a mi+ - +ms val a (gTpI ms_1 ^ • • • gjpl'" 1 " 1 g^T) 

for all positive integers m 1; . . . ,m s . 

Proof. We proceed by induction on s. Suppose first that s — 1. If m-i > 1, Lemma [7] 
implies 

™ / A^ Ax val a (6 mi ) + S x \ / A 2 B 2 

' " d M o c 2 



, mi / AxA 2 a mi Ax^a" 11 + A X C 2 val a (6 mi ) + ^C, 



' ' dC 2 



_7Ti]^ —1 



cmi f A!A 2 a mi val a ( A 1 B 2 A x C 2 b C 2 (A l b + B x 



dC 2 

This implies the claim for s = 1. 
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Let then s > 1 and assume inductively that we have computed rational numbers 
qx, . . . , q s+ \,pi, . . . ,p s such that ([T]) holds for all mi, . . . ,m a > 1. Let m s+ i > 1 and 



let N s+2 



* + / -/ + ). For the sake of brevity, let us denote d\ = A\ ■ ■ ■ A s+ i, 
A B 



d 2 = d--- C s+l and N s+2 = ( Q c ). Then 

N x M mi N 2 M m2 N 3 --- N s+1 M ms+1 N s+2 



+ ... +ms , d ia ^ + - +m ° T \ f a m ^ val a (6 

1 d 2 C [ 1 



T m S + lN 



U+-+m s+ i / did" 11 



d 2 ) l C 



A B 
C 

T m s+1\ 



1+ ... +ma+1 ( d 1 Aa m ^+-+ m ^ d,a m ^ 







[Ba m *+* + L7val a (6 ms+1 )) + CT 
<h.C 



where T = val a (gipi'" s g 2 • • • q s p s mi q s +i)- We compute d 1 A — Ai • • • A s+2 , d 2 C 
Ci • • • C s+2 and 

d/^'^fBo^ 1 + L7val a (6 ms+1 )) + CT 



_m s+1 -l 



_771 1 — 1 



= val a (<i 1 5 diCb C{d 1 b + g x ) Cpi Cq 2 ■ ■ ■ Cq s Cp s Cq s+ i). 

This concludes the proof. □ 

3.2. Comparison of the representations. If X is an alphabet, we let S be the 
alphabet defined by 

' r <*! 



a 2 



: a 1 ,a 2 eE} . 



A word in X given by 



will be written as 



CT; 



a 



31 



o~;. 



a 



J 2 



(J; 



a 



j i 



a h a i2 ■■■o il 



In what follows it is important to observe that if we have a word 



w 2 



in E* then 



necessarily the words W\ and w 2 have equal lengths. 

The next lemma shows that in comparing the representations of rational numbers we 
can use regular languages. 

Lemma 9. Let S C Q be a finite nonempty set, let S\ = {s: s G S} and let X = Si. 
Let r G Q\{ — 1,0, 1}. Then the language 



L 



Wi 

w 2 



G X : val r (iyi) = vaL(u> 2 ) 



is effectively regular. 
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Proof. First, observe that 

vaL(x n ■ ■ • XiXo) = val r (?/ n ■ ■ • yiy ) 

holds if and only if 

val r -i (x xi • • • x n ) = val r -i (y y 1 ■■■y n ) 
holds (here, the x^s and y^s are digits). Because the class of effectively regular lan- 
guages is closed under reversal, we may assume \r\ > 1 without loss of generality. 
Next, we assume without loss of generality that 

S = {—m + 1, — m + 2, . . . , — 1,0, 1, . . . , to — 2, to — 1} 

where m is a positive integer. In other words, we will assume that 



X 



a 
b 



: a,b G {— m + 1, — m + 2, . . . , — 1,0, 1, . . . ,m — 2,m — 1} 



Let r = -, where u, v G Z do not have any nontrivial common factor. Let d - 
We define the nondeterministic automaton A = (Q, X, 5, {qo}, {qo}) as follows: 

Q = {qi : i G [-d, d] H Z} 

and 

qj, if i + a — b = rj; 

0, if ^=6 ^ [_^ d]nz. 

We will prove £(-4) = L T . (Here L T is the reversal of L.) 



2m-2 
lrl-1 ' 



%» 



a 
b 



) 



Assume first that 



a Q 




Oi 




On 



eL T , 



or, equivalently, 

(2) a + a x r + • • • + a n r n = b + b x r + • • • + 6 n r n . 

We claim that there exist states q ai , q a2 , . . . , g a „ +1 G Q such that 



%o, 



Of, 
&0 



Oi 

&1 



a. 



) = <?a I+1 



"- t - 1 = fe m + --- + 6„r"- 1 - 1 



(3) 

and 

(4) a i+1 + Oj+i H \-a n r 

hold for all i — 0, . . . , n. 

We first show the existence of q ai . Because (J2J) implies 

a f n + axuv 11 ' 1 H h a n n n = 6 v n + huv n ~ l -\ h 6„u n , 

we have a = 6 mod -u. Hence 

ao - ^o («o - M u 

Oil = = 

r u 

is an integer. Because |ao| < m — 1 and \bo\ < m — 1, we have 

|«o - &o| 



\aii\ 



< d. 
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and hence the state q ai exists. 
Further, we have 



and 



%o, 



Oo 

bo 



) =Qai 



Qi + ax + a 2 r -\ h a n r n l = b l + b 2 r^ h b n r n 1 . 

This proves the claim for % — 0. 

Assume then j G {1, . . . , n) and assume that there exist q ai , . . . , q a . e Q such that 
(ED and (H hold for i = 0, . . . , j - 1. From (0} it follows 

a, + a, = 6j mod u. 

Hence 

ctj + Oj — 6j (a, + aj — bj)v 



a j+1 



u 



is an integer. Because we have 

\(Xj + a,j — bj\ \cxj\ + |% — bj\ d + 2m — 2 d + d(|r| — F 



l«i+i| 



< 



< 



the state q a+1 exists. Further, we have 



Jo _ 




a\ 




Jj . 



, a® ax aj •. , 

%o, jr r- ••- r- )=%<*„ 



bj 



) = Qoj+i 



and 



a j+1 + ttj+i + a j+2 r -\ \- a n r n j x = b j+1 + b j+2 r H Yb r , 



r.n-j-1 



This concludes the proof of the claim. 
From the claim it follows 



a 
Jo . 




ax 




. b ™ . 



, uo a\ a n n 



and 














a n +i = 


= 0. 


Therefore 








«o 
. b o . 




ax 




. b " . 


Hence L T C L(A). 






Suppose now that 








ob" 
. b o . 




ax 




. b " . 



e L(A). 



e L(A). 



Then there exist states q ao ,q ai , . . . , q a „ +1 £ Q such that 



%o 



Oj 

b; 



) ^cti+l 



for i = 0, . . . , n and ao = a n+ i = 0. By the definition of A we have 

a.i + ai — bi = rcti+x 
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for i = 0, . . . , n. This implies 

ao + ciir^ h a n r n = b + b x r-\ h b n r n . 

Hence 



a 




CLi 




On 



eL 1 



Therefore L(A) C L T . 



D 



3.3. A decidability method for Theorem [TJ, We are now ready for the proof of 
Theorem [TJ 

Let t be a positive integer and assume that 



^■■n^ 



^2x2 
tuptr 



is a morphism such that /J,(zi) is nonsingular for i — 1, . . . , t + 1. 

First, we consider the particular case where /i(x) is singular. Suppose fj,(x) = 

„ „ J, the case /i(x) = ( n ) being symmetric. Then fi(x n ) = a n ~ 1 /j,(x) for 

all n > 1. If t = 1, then /i in injective on 1^ if and only if a ^ { — 1, 0, 1}. If £ > 2, then 
the equation n(x 2 z 2 x) = fi(xz 2 x 2 ) implies that /i is not injective on L t . 
For the rest of the proof we suppose that fx(x) is not singular. Let 



fx(x) = M = c 



and, for i = 1, . . . , t + 1, let 



p(zi 



N: 



a 


b 


v 


1 


4, 


5 





c, 



where a,b,c,Ai, Bi,Ci G Q for i = 1, . . . , t + 1. Because M and iV, are nonsingular, 
a, c, A^, Q are nonzero for i — 1, . . . ,t+l. 

If a = — 1, then M 2 = c 2 /. If t > 2, then /i is not injective on L t because we 
have N 1 M 2 N 2 = N 1 N 2 M 2 . If t = 1 and c G {-1, 1}, then // is not injective on L t 
because N\N 2 = N\M 2 N 2 . If t = 1 and c G" {—1,1}, it follows from the equation 
det(M n ) = (— c) n that \i is injective on L t . 

For the rest of the proof we suppose in addition that a/ -1. We suppose also that 
o^l. In fact, we have already proved Theorem [TJ if a = 1 in Examples HI [5] and [6j 

For each subset K C {1, . . . , £}, let 



L 4 (K) = {z l3 ; m ^ 2 x m ^3 • ■ ■ ^ m ^ m : m, 



for z G if, rrii> 1 for z G" K}. 



Now L t is a disjoint union of the languages L t (K) where K runs over all the subsets of 
{1, . . . , t}. Hence the morphism \i is injective on L t if and only if 

(i) for each K C {1, . . . , t}, // is injective on L t (K); and 

(ii) if Ki,K 2 C {l,...,t} with K\ ^ K 2 , then there does not exist two words 
w\ G L t (Kx) and w 2 G L t {K 2 ) such that \x{p\) = ^{w 2 ). 
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We first prove that (ii) is decidable. For w\ G L t {K\) and w 2 e L t (K 2 ), we have 

Mwi) = N[M H N' 2 M k2 N>, - - - N' s M ksi N' Sl+1 

and 

H(w 2 ) = N'lM" 1 N^M i2 N%--- N' s ' 2 M ta2 N' s ' 2+1 
where sx = t — \Ki\, s 2 = t — \K 2 \, k{ > 1 for i — 1, . . . , si, £j > 1 for j — 1, . . . , s 2 and 

AW ■ ■ • N t+1 = N[N> 2 - - - N' si+1 = N?N» ■ ■ ■ N' s ' 2+V 
In view of Lemma El deciding (ii) is equivalent to deciding the following two problems: 

A: Given positive integers Sx,s 2 and rational numbers pi,...,p si , q±, . . . , q Sl +i, 
«!,..., a S2 , /?i,..., /S S2+ i, decide whether there exist positive integers kx, ■ ■ ■ ,k si , 
£i , . . . , £ S2 such that the two matrices 

: ( A x ■ ■ ■ A t+1 a kl+ - +k ^ val a (gTpT S1 cfe ■ ■ ■ q^^ 1 " 1 Jfa^] 
and 



(5) c^+-+ k , M 

Oi • • • U i+ i 



/ 6 \ c 4+-+4 2 ( M--- A t+1 a ei+ - +ea 2 val a (/?i ai " 2 /3 2 • • • As 2 a^' 1 * & 2 +i) 

V o C\- • • c t +i 

are equal. 

B : Given a positive integer s and rational numbers q,px, . . . ,p s , qx, . . . , q s +i, decide 
whether there exist positive integers k\ , . . . , k s such that the two matrices 

k 1 +-+k s ( Ax--- A t+1 a kl+ '" +ka ^ra\. a {qiPi ks ~ 1 Q2 • • • Tspf 1 ' 1 ql+i] 



(7) °' V C'r--C',-j 

and 

' Ax--- A t+1 q 



(8) V ° Cx---C t+1 
are equal. 

Problem B corresponds to the case where one of the subsets Kx and K 2 is equal to 
{1, . . . , t}. Because the products ac, A x - ■ ■ A t+l and C\- •• C t+ x are nonzero, a necessary 
condition for the equality of © and (jHJ) is 

a ki+-+k s = L 

Because a $. {— 1, 1} this condition never holds and Problem B has no solutions. 

We now turn to Problem A. Because the products ac, Ax ■ ■ ■ A t+1 and C\ • • • C t+ x are 
nonzero, ([SD and (jSJ are equal if and only if 

(9) a ki+-+k si = a h+-+e e ^ 

(10) c ki+-+k si _ c h+-+e.s 2 
and 



11) val a (qxPx ' q2---q sl Psi q n +i) = val a (/3iai /3 2 • • • /3 S2 a S2 p n+ i). 
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Because a^{— 1,0,1} (jUJ and (HUD hold if and only if 

(12) k 1 + -'- + k ai = £i + ---+e aa . 

Let now S = {q ll . . . , q ai+1 ,p u . . . ,p si , (3 ll . . . , (3 S2+ll a u . . . , a S2 }, let S t = {s: s E S} 
and let X — Si. Let 



L 



Mi 

u 2 



E X* : val a («i) = val a (M 2 ) 



and let 



Tl 



Ml 

H-2 



E X : mi e qipi* q 2 • ■ ■ q si p Sl * q Sl +i, u 2 E Pi oT /3 2 • • • /3 S2 a S2 * (3 S2+1 > . 



By Lemma [9j L is effectively regular. So is clearly Ti. In fact, it is easy to construct 
a finite automaton which accepts Ti. Now we can decide (ii) by checking whether or 
not 

L n T x = 0. 



Indeed, suppose a word 



Mi 
M 2 



integers fei, . . . , k si , l\, . . . , £ S2 such that 



E X* belongs to L fl Ti. Then there exist positive 



Mi = q 1 pi 



Q2 ■■■ q si p n Qsi+i 



and 



Because 



M 2 = Pi «i S2 /3 2 • • • Ps, a 



2 "^2 



/3. 



S2 + 1- 



Ml 

'"2 



G T fl Ti, we have val a (wi) = val a (w 2 ) and |mi| 



|m 2 |. The latter 



condition means that 



k Sl + • • • + fa + 1 = £ S2 + ■ ■ ■ + £i + 1 

which gives (Tl2l) . Hence (jSD and (JUJ are equal. Conversely, if there exist positive integers 
ki, . . . ,k si ,£i, . . . ,l S2 such that the matrices (JSJ and ([UJ are equal, then 



9iPi 



Q2 ■■■ q n P S1 



Qsi+i 



Pi Oil ^ Pi"- Ps 2 U s 



P. 



S2 + 1 



ELHTi. 



To conclude the proof of Theorem [T] it remains to prove that also (i) is decidable. 
We have to decide a variant of Problem A where si = s 2 , Pi = oti and q^ = Pj for 
1 < i < si, 1 < j < Si + 1 and we have to find out whether there exist two different 
Si-tuples (ki, . . . , k si ) and (£i, . . . , £ Sl ) of positive integers such that (fTTj) and ( 112]) hold. 
Before we can proceed as we did above in case (ii) we have to check whether there exist 
different Si-tuples (fci, . . . , k Sl ) and (£i, . . . , £ S1 ) of positive integers such that 



<?i Pi 



Q2 ■■■ q Sl p Sl q Sl +i = qiPi q-2 • • • q 8l P Sl q Sl +i- 

Observe that such s x -tuples may exist, for example, they do exist if pi = q 2 = P2- 
However, it is easy to decide whether there are such si-tuples. If there are, \i is not 
injective on L t (K). We continue with the assumption that such si-tuples do not exist. 
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Then we can decide (i) proceeding as we did above. The only difference is that we 
replace Ti by 



T 9 



Ml 

U-2 



eT l :u 1 ^u 2 \. 



This is done because we do not want T 2 to include words 



Mi 

U-2 



such that 



Ui=qiPi q 2 ■■■ q Sl P Sl q 8l +i, 

u 2 = qiPi Sl 92---fePl7 1 fe+T 

and 

yki, . . . , k Sl ) = {ii, . . . ,i Sl )- 

Observe that we did not have this problem in case (ii) because there the languages 
L t (Ki) and L t (K 2 ) were disjoint. 

4. Proof of Theorem [2] 



Let us fix some notation first. If Ax, A 2 , . . 



A ± ®A 2 



A* is 



/ A 1 
A 2 

V 



A* are matrices, then their direct sum 



\ 





A s J 



HA 



Hj Jmxn 



and B are matrices, then their Kronecker product A © B is 



( a u B a l2 B 
a 2 \B a 22 B 

\ a m,\B a m2 B 



a im B ^ 

&2mB 



In both cases, we have used block notation. 

The direct sum and the Kronecker product have the following properties: if Ai,A 2 , 
. . . , A s are m x m matrices and B±, B 2 , . . . , B s are n x n matrices, then 



(Ax © B 1 ){A 2 © B 2 ) ■ ■ ■ {A s © B 8 ) = {A X A 2 ■ ■ ■ A s ) © {B 1 B 2 ■ ■ ■ B s 



and 



(A x © B X )(A 2 ® B 2 ) ■ ■ ■ (A s © B a ) = (AxA 2 ■■■A 3 )® (BxB 2 ■■■B s ). 

For more details on the Kronecker product, see for example |LT85[ Chapter 12] or 
|K5S5] . 

If k is a positive integer, then Ek = (eij)kxk is the k x k matrix whose only nonzero 
entry is exk = 1- 

The main idea of our proof of Theorem [2]is to use the undecidability of Hilbert's tenth 
problem combined with the following result. Suppose that t is a positive integer and 
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that p(xi, . . . ,x t ) is a polynomial with integer coefficients. We want to find a positive 
integer k and matrices A, M,N, B G Z k p t k such that 

AM ai NM a2 iV • • • NM at B = p(oi ,...,a t )E k 

for all nonnegative integers a±, . . . ,a t . 
Fix the value of t. 

Lemma 10. Let i G {1, ...,£}. T/ien t/iere exists a positive integer k and matrices 
A, M,N,B G Z^ t k r suc/i t/iat 

AM ai NM a2 N--- NM at B = a { E k 

for all nonnegative integers a±, . . . , a t . 

Proof. Let k = 2t, 



A 



( l o 









V 

where A, B G Z^ t k r . Let £? = 



and B 



0/ 



1 1 
1 



and / 







1 
1 



\ 




■ 1/ 
Let 



M 



I@E®I 



where there are t summands of which E is the ith one, and let 



N 



( / 

0/ 





V o o o 







I 

0/ 



be a A; x A; matrix where each stands for the 2x2 zero matrix. 
Then A, M,N,B G Z^ t k r and we have 



AT' 



I 
I 



I 
I 



E n ®I 
1 n 
1 



for all n G N. 

Now, if .D is any matrix in Z U p tr then the only nonzero entry of ADB is the last entry 
in the first row, which is equal to Di k . Let us compute this entry for 



AM ai NM a2 N---NM at B 
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where oi, . . . , o* are nonnegative integers. For this, we regard M and N astxt matrices 
consisting of 2 x 2 blocks: 

(M ai NM a2 N---NM at ) lt 

= (M ai ) u N 12 (M a2 ) 22 N 23 ■ ■■N l _ 1 ,{M a ') ll N hl+l ■ ■ ■ N t _ ht (M at ) tt 

1 (U 



I ■ I •/•••/ • ( ' l 
1 1 



1 Oj 

1 



/•••/ 



The results follows. 



D 



Lemma 11. Let p\{x\, . . . , x t ) and p 2 (x±, ■ ■ ■ , %t) be polynomials with integer coeffi 

7S 1 X! 

J uptr 



cients. Suppose there exist si,s 2 > 1, Ai,Mi,Ni,Bi G Z^ r Sl and A 2 , M 2 ,N 2 ,B 2 G 



Z upto 2 such that 



and 



A 1 M a 1 1 N.Ml 2 N x ■ ■■N l M a l t B 1 = Pl ( ai , ..., a t )E sl 



J «2 



A 2 M 2 N 2 M 2 N 2 ■ ■ ■ N 2 M 2 B 2 = p 2 {a u . . . , a t )E s 
for all oi, . . . , a t G N. Then 

(i) there exist s 3 > 1 and A 3 ,M 3 ,N 3 , B 3 G Z^,*/ 3 such that 

A 3 M a 3 ' N 3 M a 3 2 N 3 --- N 3 M a 3 l B 3 = ( Pl + p 2 ) (o 1; . . . , a t )E S3 

for all a±, . . . ,a t G N; 
(ii) there exist s 4 > 1 and A 4 , M 4 , N 4 , B 4 G Z^,*/ 4 such that 



A 4 M/N 4 M 4 2 N 4 ■ ■ ■ N 4 M^B 4 = ( Pl ■ p 2 )( ai , ..., a t )E. 

for all oi, . . . ,at G N; 
(iii) if c G Z 7 t/ien t/iere exists A^ G Z*p* r Sl snc/i that 

A^Ml 1 N t M; 2 JVi • • • NiA^'Si = c • Pl (oi, . . . , o*)£ Sl 

/or all Oi, . . . , Ot G N. 

Proo/. To prove (i) we take M 3 = Mi © M 2 , N 3 = N x © JV 2 , 



«4 



A, 



/l 1 ••• 1\ 

••• 



V ••• / 



and 



B 3 = (5! © B 2 ) ■ 







(A © A 2 



1\ 

1 



\0 ••• 1 / 



14 



E. CHARLIER AND J. HONKALA 



To prove (ii) we take A 4 = A 1 ^A 2 , M 4 = M 1 ®M 2 , N 4 = Nx®N 2 and B 4 = B X ®B 2 . To 
prove (iii) it suffices to take A§ = cA\. Then the claims follow by simple computations 
which are left to the reader. □ 

Now our goal is achieved and we can state the following lemma. 

Lemma 12. Let t be any positive integer and p(xi, . . . ,Xt) be any polynomial with 
integer coefficients. Then there effectively exists a positive integer k and matrices 
A, M,N,B e Z^ t k r such that 



AM ai NM a2 N---NM at B 







\o 



p(ai,...,ot) \ 




for all ax, . . . , at G N. 



Remark 13. Lemma[T2lis closely related to the well-known fact stating that if p(xx, . . . ,x t ) 
is a polynomial having integer coefficients, then the series 



ni,...,nt>0 



, n t ) x ni yx n2 y ■ ■ -yx 



n t 



is Z-rational; see for example |SS78j . The purpose of Lemma [T2l is to show explicitly 
that we can get this result using only upper-triangular matrices. 

We will use a strong version of the undecidability of Hilbert's tenth problem as stated 
in the following theorem (see Theorem 3.20 in [RS94J. 

Theorem 14. There is a polynomial P(xx,x 2 , ■ ■ ■ ,x m ) with integer coefficients such 
that no algorithm exists for deciding whether an arbitrary equation of the form 

P(a,x 2 ,. ■ .,x m ) = 0, 

where a is a positive integer, has nonnegative integers x 2 , . . . , x m as a solution. 

For k = 2, 3, . . ., define the Cantor's polynomials C 2 , C3, ... as follows: 



C 2 (xx,x 2 ) ■ 
C k+ x(xx,---,x k +x) = C 2 (C k (xx,...,x k ),Xk+x)- 



-(xx + x 2 ){xx + x 2 + 1) + x 2 , 



These polynomials are injective onN . In other words, for all nonnegative integers 
nx, ■ ■ ■ , n k , mx ■ ■ ■ , m k , if C k (nx, . . . , n k ) = C k (mx, . . . , m k ) then n ± = ra 1 , . . . ,n k = m k . 
Note that the C k s are not injective on Z . 

Let P(xx, ■ ■ ■ ,x m ) be as in Theorem [TH Take a new indeterminate x m+ x and define 
the polynomial Q(xx, • • • , x m , x m+ x) by 

ItgyXxi • • • 1 'Xmi X-m+l) C ' ^m+1 \XXi ■ ■ ■ i X m , 1 [Xli ■ ■ ■ > X m ) • X rn j r \) , 

where e is a positive integer chosen such that Q has integer coefficients. 
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Lemma 15. Let a be a positive integer. Then the equation P(a, x 2 , ■ ■ ■ ,x m ) = 
has a solution in nonnegative integers if and only if there exist nonnegative integers 
62, • • • , b m+1 , c 2 , . . . , c m+1 such that 

(13) Q(a, b 2 , ... , b m+1 ) = Q(a, c 2 , . . . , c m+1 ) 
and 

(14) (6 2 , • • • , bm+i) 7^ ( c 2, • • • , Cm+l). 
Proof. Suppose first that there exist d 2 , ■ ■ ■ , d m G N such that 

P(a,d 2 ,...,d m ) = 0. 

Then we have 

Q(o, d 2 ,...,d m ,x) = e- C m+1 (a, d 2 , ■ ■ ■ , d m , 0) 
for any x G N. Hence, if we choose 

(62, . . • , m +i) — («2j • • • 1 ^m> 1) and (c 2 , . . . , c m+ i) = (d 2 , . . . , d m , 2), 

then (TT3D and flUD hold. 

Suppose then that P(a, d 2 , . . . , d m ) 7^ for all <i 2 , ■ ■ ■ , d m G N. Suppose that 

<3(a, 6 2 , • • • , b m+1 ) = Q(a, c 2 , . . . , c m+ i) 

where 6 2 , • • ■ , &m+i, c 2 , . . . , c m+ i G N. Hence 

Cm+i(fl) b 2 , . . . , b m , P(a, b 2 , . . . , o m ) o m +i) = C m+ i(a, c 2 , . . . , c m , P(a, c 2 , . . . , c m ) c m+ i). 

Because C m+ i is injective on M m+1 we obtain 

(15) b 2 = c 2} ...,b m = c m 

and 

P(a, 6 2 , • • • , b m ) 2 b m+1 = P(a, c 2 , . . . , c m ) 2 c m+ i. 
Using ffl5l) and the assumption 

P(o, 6 2 , • • • , M = P(o, c 2 , . . . , c m ) ^ 0, 

we obtain 6 m+ i = c m+ \. Consequently, if P(a, x 2 , . . . , x m ) = does not have a solution 
in nonnegative integers, then there does not exist b 2 , . . . , b m+ i, c 2 , . . . , c m+ i G N such 
that fll3D and (03J hold. □ 

We are now ready for the proof of Theorem [2j 

Let P(xi, . . . , x m ) and Q(xi, . . . , cc TO +i) be as above. By Lemma [121 there is a positive 
integer k and a morphism fi: A* — ► Z U p tr such that 

ix{z x x ai yx a2 y ■ ■ ■ yx am+1 z 2 ) = Q(a u ..., a m+1 )E k 

for all ai, . . . , a m +i G N. For each aeN define the morphism /j, a : A* — > Z U p tr by 

fJ- a {zi) = /i(^ix a j/), fj, a (x) = n(x), fi a (y) = fJ>{y) and fj, a (z 2 ) = fJ,(z 2 ). 

Then 

li a {zix a2 y ■ ■ ■ yx am+1 z 2 ) = Q(a, a 2 , . . . , a m+1 )E k 
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for any a > 1 and 0,2, ■ ■ ■ , o m +i £ N. By Lemma [T5| for any a > 1, the morphism /U a is 
injective on K m if and only if the equation P(a, 22 . . . , x m ) = does not have a solution 
in nonnegative integers. Now Theorem [2] follows by Theorem HU 

5. Concluding remarks 

In the proof of our undecidability result we used singular matrices. On the other 
hand, in Theorem [1] we require that fx(zi) is nonsingular for i = 1, . . . ,t + 1. This 
assumption plays an essential role in our proof of the theorem. At present we do not 
know how to avoid using this assumption. 

The following examples illustrate the situations where some of the matrices fi(zi), 
1 < i < t + 1, are singular. The first two examples show that the singularity of some 
n(zi) often implies that fi is not injective while the third example shows that this is not 
always the case. In these examples we use the notations of Section 3. 

Example 16. Let t > 2 and assume that there is an integer i, 1 < % < t — 1, such that 
Ni is of the form I _ „ ) , where B, C £ Q. Then 

N t MN l+l = N t N t+1 M, 
which implies that \x is not injective on L t . 

Example 17. Let t > 2 and assume that there is an integer i, 3 < i < t + 1, such that 
iVj is of the form I „ „ J , where A, B £ Q. Then 

MN^Ni = N^MNi, 
which implies that \x is not injective on L t . 
Example 18. Let t > 1 and let 



JVi = JV 2 = ... = JVi=( - 1 ),iV m =( , , ),M 



Si).*»-(Si)."-(S! 

Then for any mi, . . . , m* > we have 

N X M 'N2M 2 N 3 ... N t M N t+1 = ( Q x 
where 

rp __ omH \-m t +t , nmH hm f _i+t— 1 _i_ . . . _i_ o"ii+m 2 +2 , nmi+1 , i 

This implies that fi is injective on L t . 
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